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Abstract —This paper investigates the capacity regions of two- 
receiver broadcast channels where each receiver (i) has both 
common and private-message requests, and (ii) knows part of 
the private message requested by the other receiver as side 
information. We first propose a transmission scheme and derive 
an inner bound for the two-receiver memoryless broadcast 
channel. We next prove that this inner bound is tight for the 
deterministic channel and the more capable channel, thereby 
establishing their capacity regions. We show that this inner bound 
is also tight for all classes of two-receiver broadcast channels 
whose capacity regions were known prior to this work. Our 
proposed scheme is consequently a unified capacity-achieving 
scheme for these classes of broadcast channels. 

Index Terms —Broadcast Channel, Capacity, Side Information 

I. Introduction 

We investigate the capacity regions of two-receiver broadcast 
channels 0 with receiver message side information where each 
receiver may know some of the transmitted messages a priori. 
These channels are of interest due to applications such as 
multimedia broadcasting with packet loss, and the downlink 
phase of two-way relay channels |2j. The capacity regions of 
these channels are known for only the following special classes 
of the two-receiver memoryless broadcast channel. 

1) Specific message request and side information configu¬ 
ration (for all types of the channel): 

a) Complementary side information: both receivers 
need to decode all the source messages, i.e., all the 
messages not known a priori 0, 0 

b) Degraded message sets: one receiver needs to 
decode all the source messages, and the other one 
only a subset of the source messages [5J 

2) Specific channel type (for all possible message requests 
and side information configurations): 

a) Additive white Gaussian noise (AWGN) channel 0 

b) Less noisy channel 

The capacity region for the less noisy case is obtained from 
the capacity region of the three-receiver less noisy broadcast 
channel where (i) only two receivers possess side information, 
and (ii) the request of the third receiver is only restricted to a 
common message demanded by all the receivers |7j Theorem 3]. 

The other results obtained from the existing capacity results 
for broadcast channels with three or more receivers, 0, 0- 
gd- fall into the mentioned results for two-receiver broadcast 
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£2 : Non-complementary Side Information 
£3 : Degraded Message Sets 

Fig. 1. Summary of the results where grey areas represent classes whose 
capacity regions were known prior to this work, and dotted areas represent 
classes whose capacity regions are established in this work for all possible 
message requests and side information configurations (the rectangle represents 
the two-receiver memoryless broadcast channel, and each oval represents one 
type of channel). 

channels with complementary side information or degraded 
message sets. 


A. Contributions 


We consider the message setup for two-receiver broadcast 
channels that includes all possible message requests and side 
information configurations as special cases, i.e., each receiver (i) 
has both common and private-message requests, and (ii) knows 
part of the private message requested by the other receiver as 
side information. We propose a transmission scheme and derive 
an inner bound for the two-receiver memoryless broadcast 
channel. We show that this inner bound (i) establishes the 
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Fig. 2. The two-receiver memoryless broadcast channel p(yi ,y 2 \ x) with 
receiver message side information. M = { M, [^ is the set of independent 
messages transmitted by the sender. K 1 = { M 5 } and K 2 = {M4} are 
the set of messages known a priori to receivers 1 and 2 respectively. W 1 = 
{Mi, M 2 , M 4 } and W 2 = {Mi, M3, M5} are the set of messages requested 
by receivers 1 and 2 respectively. Mi, i = 1,2,4, is the decoded M, at 
receiver 1, and Mi, i = 1, 3, 5, is the decoded Mi at receiver 2. 



















































Ri+R 2 +Ri<I{U 0 ,Ui-,Yi), (1) 

Ri+R 3 + R 5 <I{U 0 ,U 2 -Y 2 ), ( 2 ) 

Ri + R 2 + R 3 + Ri< I(Uo, C7i; li) + I{U 2 ; F 2 | C/ 0 ) - J(£/t; ^2 I U 0 ), (3) 

Pi + R 2 + R 3 + R 5 < I{Uo, u 2 ; y 2 ) + I(Ui;Yi \ U 0 ) - J(C7i; J7 2 | J7 0 ), (4) 

2i?x + i? 2 + i? 3 + P 4 + P 5 < I{U 0 , Ui-,Yi) + I{U 0 , Ur, y 2 ) - J(C/i; U 2 \ U 0 ). ( 5 ) 


capacity regions for two new classes, namely the deterministic 
channel and the more capable channel, and (ii) is tight for all 
classes of two-receiver broadcast channels with known capacity 
regions. A summary of the results is illustrated in Fig. |T] 

II. System Model 

We consider the two-receiver discrete-time memoryless 
broadcast channel p(yi,y 2 \x), depicted in Fig. [ 2 j with input 
X £ X, and outputs Y± £ 34 and Y 2 £ y 2 . In this channel, 
X n = (X\. X 2 ..... X n ) is the transmitted codeword, and 
Yfi = {Y i i,Y i2 ,...,Y. in ), i = 1 , 2 , is the channel-output 
sequence at receiver i. The transmitted codeword is a function 
of source messages, M = {Mf} f =1 . The source messages 
are independent, and Mj is uniformly distributed over the set 
Mi = { 1 , 2,..., 2 nRi }, i.e., transmitted at rate Ri bits per 
channel use. 

We define two sets corresponding to each receiver. Wi = 
{Mi, M 2 , M4} and W 2 = {Mi,M 3 ,M 3 } are the set of mes¬ 
sages requested by receivers 1 and 2 respectively. Ki = {M 5 } 
and K 2 = {M4} are the set of messages known a priori to 
receivers 1 and 2 respectively. For receiver 1 , M 2 is the part 
of the private-message request which is not known a priori to 
the other receiver, and XI4 is the part which is known. For 
receiver 2 , these are M 3 and M 5 respectively. 

A ( 2 nRl , 2 nR2 , 2 nRa , 2 nRi , 2 nRa , n) code for the channel 
consists of an encoding function 

/ : Mi x M 2 x M 3 x M4 x M 3 -> X n , 
where x denotes the Cartesian product, and X n denotes the 
rx-fold Cartesian product of X. It also consists of decoding 

functions . . . . . . . . 

g 1 : y{ x M 5 -> Mi x M 2 x M 4, 

g 2 : y 2 x M4 Mi x M 3 x M 5 . 

Average probability of error for this code is defined as 

P e (n) = P((Mi,M 2 , M 4 ) ^ ( Mi,M 2 , M4) or 

(Mi,M 3 ,M 5 )^(Mi,M 3 ,M 5 )), 

where M, i = 1 , 2 , 4 , is the decoded M, at receiver 1 , and 
Mi, * = 1 , 3 , 5 , is the decoded M t at receiver 2 . 

Definition 1 : A rate tuple (f?i, R 2 , R 3 , R4, R 3 ) is said to 
be achievable for the channel if there exists a sequence of 

(2 nRl , 2 nR2 , 2 nRs , 2"' R 4 j 2 nRs , n) codes with P e (n) -> 0 as 
n —> 00. 

Definition 2 : The capacity region of the channel is 
the closure of the set of all achievable rate tuples 

(Ri,R 2 , R 3 , Ri, R 3 ). 

Definition 3 : A two-receiver memoryless broadcast channel 
is said to be deterministic if the channel outputs are determinis¬ 
tic functions of the channel input, i.e., Y-j = 0 t (X), i = 1, 2. 


Definition 4 : A two-receiver memoryless broadcast channel 
is said to be more capable if I (X: Y-]) > I (X: Y 2 ) for all 
input distributions p(x). 

III. Proposed Scheme and Inner Bound 

In this section, we propose a transmission scheme and derive 
an inner bound for the two-receiver memoryless broadcast 
channel with receiver message side information, stated as 
Theorem [Tj The transmission scheme is constructed using 
Marton’s coding scheme 112 p. 205 ], superposition coding |T], 
and rate splitting. 

Theorem 1 : A rate tuple (Ry, R, 2 . R 3 , Ri, R, 3 ) for the two- 
receiver memory less broadcast channel p{yi,y 2 \ x) is 
achievable if it satisfies for some p(uo,Ui,u 2 ) and 

some function x = 7(1x0, u\, u 2 ). 

Proof: (Codebook Construction) The codebook of the 
transmission scheme is formed from three subcodebooks which 
are constructed according to the distribution p(uo,ui,u 2 ). 
Before subcodebook construction, using rate splitting, Mj, i = 
2 , 3 , is divided into two independent messages Mu at rate Rn, 
and M i2 at rate R i2 such that Ri = R i3 + R i2 . 

The first subcodebook consists of i.i.d. codewords 
Mq(toi, TO4, ms, m 2 i, 77131) generated according to 
n"=iPi/o(«o,i) for each {mi, m 4 , m 5 , m 21 , m 31 ). 

The second subcodebook consists of codewords 
Ui (mi, 7774,7775, to 2 i, 77731, to 22 , h) generated according to 
n;=ift 7 iPo(«*U I u 0 j{mi,m 4 ,m 5 , m 21 ,m 31 )) where l 3 £ 
{ 1 , 2 ,..., 2 nfl i}, i.e., for each (77x1,77x4,777.5, ?tx 2 i, 77x31, ?tx 22 ), 
2 nR i codewords are generated. 

The third subcodebook consists of codewords 
7X2 (77x1,7714,77x5, ?tx 2 i, 777.31,777.32, h) generated according to 
H]=iPu 2 \U 0 (u2,j I 7 X 0 J(77x1,77x4,7715, 77 X 21 ,77x31)) where l 2 £ 
{ 1 , 2 ,..., 2 nR ' 2 }, i.e., for each (7711,77x4,7715,77x21,77x31,77x32), 
2 nR 2 codewords are generated. 

(Encoding) For the encoding, given {? 7 ij}f = i, we first find 
a pair (h,l 2 ) such that 

{Uq (’), Ui (-, Zi), U£ (-,^2)) £ TP, 
where Tf is the set of jointly e'-typical xx-sequences with 


respect to the considered distribution 112 p. 29 ]. If there 
is more than one pair, we arbitrary choose one of them, 
and if there does not exist one pair, we choose (h,l 2 ) = 
( 1 , 1 ). We then construct the transmitted codeword as Xj = 

7(wo,i (•), Uij (•), tx 2 ,j (•)). 3 = 1,2, • • •, n. 

( Decoding) Receiver 1 decodes (77x1,77121,77x22,77x4), if it is 
the unique tuple for which we have 

{Uq (•), Ui (-, /l), y") S T™ for some 77131 and h; 

otherwise the error is declared. 






£ 0 : (Uq (1,1,1,1,1), U™ (1,1,1,1,1,1, li), U£ (1,1,1,1,1,1, 12 )) £ 77 for all h and l 2 , 

£n ■ (US ( 1 , 1 , 1 , 1 , 1 ), U?( 1 , 1 , 1 , 1 , 1 , 1 , 2 nRl ), Yf) i 7 £, 

£12 : (US (1,1,1,1,1), US (1,1,1,1, l,m 22 ,h) ,YS) G 7,S for some m 22 ^ 1 and h, 

£13 : (US (mi,m 4 ,1, m 21 , m 31 ), C/” (mi,rn 4 , l,m 2 i,m 3 i,m 2 2 ,M , V") G T? 

for some mi ^ 1, to 4 , 77121 , 77131,77122 and l\. 


( 6 ) 

(7) 

( 8 ) 
( 9 ) 


Receiver 2 similarly decodes (mi,77131,77732,7715), if it is 
the unique tuple for which we have 

(t/ 0 n (•), US (;h), IT) G 7 T for some m 2 i and Z 2 ; 
otherwise the error is declared. 

We assume the transmitted messages are equal to one by the 
symmetry of code construction, and without loss of generality 
(h,l 2 ) = ( 2 ni? 1 , 2 " i?2 ). Hence, the error events at receiver 1 
are note that there exist some other error events, but 

they yield redundant achievability conditions. The error events 
at receiver 2 are similarly written. Based on the error events, 
packing lemma p. 45 ], and mutual covering lemma JT 2 ] 
p. 208 ], the achievability conditions are 

R[ + R' 2 > I (Ui;U 2 | U 0 ), 
R 22 + R[<I(U 1 -,Y 1 I Uo), 

R\ + f?2i + R 3 i + Ri + R22 + R'i < I (Uo, Ui\ Y -\), 

R 3 2 + R 2 <I(U 2 ;Y 2 I Uo), 

R\ + -R21 + R31 + R5 + f ?32 + R 2 < I (Uq, U 2 ; Y 2 ). 

We finally perform Fourier-Motzkin elimination to obtain the 
region in Q- 0 . ■ 


IV. Capacity Results 

In this section, using the derived inner bound in Theorem [l] 
we establish the capacity regions for two new classes, i.e., 
the deterministic channel, stated as Theorem [2j and the more 
capable channel, stated as Theorem [3] We also show that our 
inner bound is tight for all classes of two-receiver broadcast 
channels whose capacity regions were known prior to this 
work. 

Theorem 2 : The capacity region of the two-receiver de¬ 
terministic broadcast channel with receiver message side 
information is the closure of the set of all rate tuples 
(Ri, R-2, i? 3 , f? 4 , R5), each satisfying 

R 1 +R 2 +Ri<H(Y 1 ), ( 10 ) 

R!+R 3 +R 5 < H(Y 2 ), ( 11 ) 

Ri + i? 2 + Ra + Ra< H(Yi) + H(Y 2 \ U, Y t ), (12) 
R1+R2 + R3 + R 5 < H(Y 2 ) + H(Y X | U, Y 2 ), ( 13 ) 
2 R± + R 2 + J ?3 + f ? 4 + f? 5 < ( 14 ) 

I(U-,Y 1 ) + H(Y 2 ) + H{Y 1 I U,Y 2 ), 

for some p(u, x). 

We present the achievability proof in the following, and the 
converse proof in Appendix A. 

Proof: (Achievability) The achievability part of Theorem[2] 
is proved by setting (Uq, Ui, U 2 ) = (U, Yi,Y 2 ) in Q-0. ■ 


Theorem 3 : The capacity region of the two-receiver more ca¬ 
pable broadcast channel with receiver message side information 
is the closure of the set of all rate tuples (R\, R 2 , R3, R4, R5), 
each satisfying 

R 1 + R 3 + R 5 <I(U-,Y 2 ), ( 15 ) 

R 1 +R 2 +R 3 + R 5 < I(U ; Y 2 ) + I(X; V, | U), ( 16 ) 

R 1 +R 2 + R 3 + Ra<I(X-,Y 1 ), ( 17 ) 

for some p(u, x). 

We present the achievability proof in the following, and the 
converse proof in Appendix B. 

Proof: (Achievability) The achievability of Theorem [ 3 ] is 
proved by setting (Uo,U\,U 2 ) = (U,X, 0 ) in 0 - 0 . Note 
that U 2 = 0 implies that M 3X = M3, and R[ = 0 . ■ 

A. Discussion on Prior Known Results 

In this subsection, we show that the derived inner bound in 
Theorem [I] is tight for all classes of two-receiver broadcast 
channels with known capacity regions, as depicted in Fig. |T] 

The capacity region of the two-receiver memoryless broad¬ 
cast channel with complementary side information is achieved 
by multiplexing all the requested messages in only one 
codebook 0 - This scheme is a special case our scheme 
obtained by setting (Uo,U\,U 2 ) = (X, 0 , 0 ). Note that M 2 
and M3 are equal to zero in this message setup. 

The capacity region of the two-receiver memoryless broad¬ 
cast channel with degraded message sets is achieved by 
superposition coding 0 - This scheme is a special case of 
our scheme obtained by setting (Uo,U x ,U 2 ) = (U,X,0) or 
(Uq, U\, U 2 ) = (U, 0 , X) depending on whether receiver 1 or 
receiver 2 needs to decode the whole set of the source messages, 
respectively. Note that either M 2 or M3 is equal to zero in 
this message setup. 

The AWGN broadcast channel and the less noisy broadcast 
channel are a subset of the more capable broadcast channel G 3 - 
as depicted in Fig. |T| then our scheme can also achieve their 
capacity regions. 

V. Conclusion 

We proposed a transmission scheme and derived an inner 
bound for the two-receiver memoryless broadcast channel with 
receiver message side information. We considered the general 
message setup which includes all possible message requests and 
side information configurations as special cases. Our proposed 
scheme is a unified capacity-achieving scheme for all classes 
of two-receiver broadcast channels whose capacity regions had 
been previously established, and for two new classes, i.e., the 
deterministic channel and the more capable channel. 





n(Ri + R 2 + -R 4 ) (Mi, M 2 , Y x | M 5 ) + ne n , 
n(Ri + i ?3 4- -R 5 ) </ (.Mi, M 3 , M 5 ; 1 ( 2 " I M 4 ) + ne„, 
n(i?i +i ? 2 + i ? 3 +i? 4 )</(M 1 ,M 4 ;F 1 n | M 5 ) +1 (M 2 , M 3 ; V", F 2 " | M 1} M 4 , M 5 ) + 3ne n , 
n(i?i + i ? 2 + -Rs + -Rs) <1 (M u M 5 ; F” | M 4 ) + J (M 2 , M 3 ; Y?, F” | M 1} M 4 , M 5 ) + 3ne„, 
n( 2 -R 1 +i? 2 +i ?3 + -R 4 + -R 5 )</(M 1 ,Af 4 ;y” | M b )+I (M u M 5 ; F 2 ” | M 4 )+J (M 2 , M 3 ; F", F 2 ” | M 1 ,M 4 ,M s )+4ne n . 


(23) 

(24) 

(25) 

(26) 
(27) 


Appendix A 


In this section, we present the converse proof for the two- 
receiver deterministic broadcast channel with receiver message 
side information. The proof is based on the converse proof for 
the channel without receiver message side information G3- 
Proof: (Converse Proof) By Fano’s inequality 112 p. 19], 
we have 


H (Mi, M 2 , M4, | Yf, M 5 ) < nei,„, (18) 

H (Mi,M 3 , M 5 I FJ\ M 4 ) < ne 2 , n , (19) 

where Ci in —> 0 as n —>■ 00 for i = 1,2. For the sake of 

simplicity, we use e n instead of e, n for the remainder. The 

inequalities in (p~ 8 ]>—(fl9|) also lead to the following inequalities, 
H(Mi,M 4 | Yf,M b ) < ne n , (20) 
H (Mi,M 5 I YJ 1 , Mi) < ne n , (21) 
H (M 2 , M 3 I Yf, Y 2 n , Mi , Mi, Ms) < 2 ne n . (22) 
Using <[T 8 ])-(l 22 ), if a rate tuple (Ri, R 2 , R 3 , Ri, R 5 ) is 
achievable, then it must satisfy |23}-(l27]i. 

Inequalities (|23|-(|27| yield conditions ([TO])—(JT4]» respectively. 
To this end, we use the Csiszar sum identity (1~2[ p. 25] based 
on which we have 


E I(Yt K ,Y 2 ,i | Mi,Mi,M 5 ,Y 2 P +1 ) 

i—1 


(28) 


= E 7 (^ +i; Y lti I Mu Mi, Ms, Y*- 1 ) , 

i =1 

where Yj- 1 = (Yi.i, Yi, 2 , ..., Yi,i-i) and Yf t+1 = 
(^ 2 , 1 + 1 , Y 2> i +2 ,..., Y 2n ). We also need to define the auxiliary 


random variable as 

U z = (Mi,Mi,M 5 ,Yr\Y 2 n i+ i). 

We here show only how inequalities ( [23] ) and ( [26] ) yield 
conditions ( flQ| ) and ( [T3| respectively. We just need to follow 
similar steps for ( [24] ). ( [25] ), and ( |27j ). 


In ( |23] >, we expand the mutual information term as follows 

I(M 1; M 2 ,M 4 ; Yj" | M5) 

< J(M 1 ,M 2 ,M 4 ;F 1 ” I M 3 ,M 5 ) 


= H (Yf | M 3 , Ms) < H (Yj") < E H (^1 ,i) • 

Z=1 

Then, since e„ -> 0 as n -) 00 , by using the standard time¬ 
sharing argument 112 p. 114], we have 

i?i + R 2 + Ri < H(Yi). 


In ( |26| ), we first expand the mutual information terms as 
in ( f29] >. We then expand part 1 of ( [29] ) as in ( |30[ i where (a) 
follows from ( [28] >. We also expand part 2 of ( |29| as in ( |3T| >. 
Finally, since e„ —>■ 0 as n —> 00 , and 
I (Up, Y 2 ,i ) + H (F M \Ui) + H (Y 2>i | Ui, Y M ) 

= M (Ym) + H (Yi ti \ Uf) — I (Y M ; Y 2>i | Ui) 


= H (Y 2ii ) + H (Y hi | Ui,Y 2ii ), 

by using the standard time-sharing argument, we have 

R, + R 2 + R 3 + R b < H(Y 2 ) + M(Fi | U, Y 2 ). 


I (Mi, M b ; Yf | Mi) + I (M 2 , M 3 ; F”, F 2 " | M 1; M 4 , M 5 ) 

= / (M 1; Mg; F 2 n | M 4 ) + I (M 2 , M 3 ; F" | M 1; M 4 , M 5 ) + I (M 2 , M 3 ; F 2 " | M 4 , M 4 , M s , F"). (29) 

S -v-' S -v-' 

part 1 part 2 


/ (M 1; M 5 ; F 2 " | Mi) + I (M 2 , M 3 ; Yf \ M x , M 4 , M s ) 

= ELi / (Ml, Ms; F 2il I Mi, Yf l+1 ) + E?=i 7 (M 2 , M 3 ; F M | M 1; M 4 , M 5 , F/ -1 ) 

< ELi 7 (Ml, M 4 , Ms, F£ +1 ; Y 2]< ) + ELi 7 (M 2 , M 3 , F 2 ” +1 ; Y m | Mi, M 4 , M 5 , F/ -1 
- T (Mi, Mi, Ms, YJ" 1 , F£ +1 ; F 2>i ) - Er=i 7 (i? _1 ; I Mi, M 4 , M 5 , F 2 " i+1 ) 

=1 J (F£ +1 ; y lfi | Mj, M 4 , Ms, F/" 1 ) + EHi 7 (M 2 , M 3 ; F^, | M x , M 4 , M s , F 

r (Mi, M 4 , Ms, FM 1 , F" ; F 2 , 4 ) + ELi I (M 2 , M 3 ; Fi, I Mi, M 4 , M 5 , F/" 1 , 


= ELi 7 
+ ELi 

(a) 

- V" 

_ Z-/2—1 


(30) 


=1 J V J 1 > ■* 2,j | ^«1,1H 4 , .^5, ^2 )i+1 ; 

^,= 1 ^ v^.i+ 1 ,^,. , ^x.^,^ 0,^1 , , ELi 7 (M 2 ,M 3 ;F m | Mi,Mi,M b ,Y±~ l ,Y^ 
= ELi / (Ml, m 4 , Ms, yt\ y^ +1 ; y 2li ) + ELi i (m 2 ,m 3; f m | Mi, m 4 ,m 5 , y;- 1 ,Y 2 n . +X ) 
= r n T (Up Y 2ti ) + ELi 77 O'M I Ui) • 


2,i+lJ 


I (M 2 ,M 3 ; Yf 


Mi, Mi, M 5 , F”) 

= iT (F 2 n | Mi, Mi, Ms, Y") = ELi ^ (^,i | M u M 4 , M 5 , F^ i+1 , Ff) 

< ELi ^ (^2,t | Mi, M 4 , Ms, F 2 ^ +1 , Fi, i; F/" 1 ) = ELi H (Y 2>i \ U x , Y hi ). 


(31) 









(32) 

(33) 

(34) 


n(Ri + i ?3 + R 5 ) </ (Mi, M a , M 3 \ Y 2 l \ M 4 ) + ne n , 
n(R\ +R 2 + R 3 + R 5 ) <1 (M 2 -Y 1 n \ M u M 3 , Af 4 , M 5 ) + I (M 4 ,M 3 , M 5 ; Y 2 n \ M 4 ) + 2 ne n , 
n(R\ + R 2 + ^3 + R 4 ) (Mi, M 2 , M 4 \ Yf I ^ 5 ) + I (M 3 ; T 2 " I M 4 , M 2 , M 4 , M 3 ) + 2 ne n . 


Appendix B 


In this section, we present the converse proof for the two- 
receiver more capable broadcast channel with receiver message 
side information. The proof is based on the converse proof for 
the channel without receiver message side information G3- 
Proof: (Converse Proof) Using ( fl 8 ] > and ( fl9| ), if a rate 
tuple (Ri, R 2 , R 3 , R 4 , R 3 ) is achievable, then it must satisfy 
@-<[54]i. 

In ( [32] ), we expand the mutual information term as follows 

I(Mi, M 3 , M 5 ; Y 2 I Mi) 

= EL 1 I(Mi,M 3 , M 5 ; Y 2<i I Mi, Yf l+1 ) 

< ELi I(Mi,M 3 , Mi, M s , Y 2 n . +1 -Y 2A ) 

< ELi I{Mi,Ms, M 4 , Ms, Yt\Y 2 n . + 1 -Y 2>i ). 

This results in 


n(Ri + R 3 + Rf) < \ I {Up, Y 2 ? i) + ne 


i —1 


(35) 


(36) 


where the auxiliary random variable Ui is defined as 

Ui = {Mi,M 3 ,Mi,Ms,Y;~\Y 2 n l+ i) . 

In ( [33] ), we expand the mutual information terms as in ( |37j ) 
where (a) follows from the Csiszar sum identity [12 p. 25] 
and (b) from (|36[i. This results in 


n(Ri + R 2 + R 3 + R 3 ) < 

n 

Y { T { U P y 2 ,i) + I{Xi\ Yi,i I Ui)) + 2 ne n , (38) 

i =1 

In ( [34| , by expanding the mutual information terms similar 
to the ones in ([33]), we have 


n(Ri + R 2 + R 3 + f?4) < 

n 

Y li,i) + /(^; r 2 ,i I Vi)) + 2ne„, (39) 

2—1 

where Uj is defined as 

V, = (Mi,M 2 ,M 4 ,M 5 ,Yr\Y 2 n l+1 ) . 

Inequality ( [39] ) yields 

n 

n(Ri + R 2 + R 3 + f? 4 ) < ' l(Xi', 1 i,i) + 2 ne n , (40) 

i=l 

because for the more capable channel, if V —> X —> (Y\, Y 2 ) 


form a Markov chain, then we have 03 p. 123] 

I(X-,Y 2 I V)<I(X;Yi I V). 

Since e n —> 0 as n —> 00 , by using the standard time-sharing 
argument 112 p. 114] for ( [35| , ( [38] ) and < [90] ), the converse 
proof is complete. ■ 
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